A Bellman Approach for Regional Optimal Control Problems in RN
نویسندگان
چکیده
This article is a continuation of a previous work where we studied infinite horizon control problems for which the dynamic, running cost and control space may be different in two halfspaces of some euclidian space R . In this article we extend our results in several directions: (i) to more general domains; (ii) by considering finite horizon control problems; (iii) by weaken the controlability assumptions. We use a Bellman approach and our main results are to identify the right Hamilton-Jacobi-Bellman Equation (and in particular the right conditions to be put on the interfaces separating the regions where the dynamic and running cost are different) and to provide the maximal and minimal solutions, as well as conditions for uniqueness. We also provide stability results for such equations. Key-words: Optimal control, discontinuous dynamic, Bellman Equation, viscosity solutions. AMS Class. No: 49L20, 49L25, 35F21.
منابع مشابه
Solving The Optimal Control Problems Using Homotopy Perturbation Transform Method
Inthispaper,wesolveHamilton-Jocobi-Bellman(HJB)equationsarisinginoptimalcontrolproblems usingHomotopyPerturbationTransformMethod(HPTM).Theproposedmethodisacombinedform oftheLaplaceTransformationMethodwiththeHomotopyPerturbationMethodtoproduceahighly effectivemethodtohandlemanyproblems. ApplyingtheHPTM,solutionprocedurebecomeseasier, simplerandmorestraightforward. Someillustrativeexamplesaregive...
متن کاملFriction Compensation for Dynamic and Static Models Using Nonlinear Adaptive Optimal Technique
Friction is a nonlinear phenomenon which has destructive effects on performance of control systems. To obviate these effects, friction compensation is an effectual solution. In this paper, an adaptive technique is proposed in order to eliminate limit cycles as one of the undesired behaviors due to presence of friction in control systems which happen frequently. The proposed approach works for n...
متن کاملFeedback controller design for linear and a class of nonlinear optimal control problems
This paper presents a feedback controller designing approach for a large class of finite-time optimal control problems. This approach involves a piecewise truncated variational iteration method (PTVIM) for solving the nonlinear Hamilton–Jacobi–Bellman equation. By using the finite iterations of PTVIM, an analytic approximate solution for value function and suboptimal feedback control law is obt...
متن کاملManifold Representations for Continuous-State Reinforcement Learning
Reinforcement learning (RL) has shown itself to be an effective paradigm for solving optimal control problems with a finite number of states. Generalizing RL techniques to problems with a continuous state space has proven a difficult task. We present an approach to modeling the RL value function using a manifold representation. By explicitly modeling the topology of the value function domain, t...
متن کاملA Numerical Approach for Fractional Optimal Control Problems by Using Ritz Approximation
In this article, Ritz approximation have been employed to obtain the numerical solutions of a class of the fractional optimal control problems based on the Caputo fractional derivative. Using polynomial basis functions, we obtain a system of nonlinear algebraic equations. This nonlinear system of equation is solved and the coefficients of basis polynomial are derived. The convergence of the num...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- SIAM J. Control and Optimization
دوره 52 شماره
صفحات -
تاریخ انتشار 2014